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The invention relates to a luminance and color separation filter unit for 
extracting a luminance signal and two color signals from a composite color television signal, 
comprising a chrominance signal being modulated on a sub-carrier which is located in the 
high-frequency part ofthe frequency spectrum of the luminance signal 

The invention further relates to an image processing apparatus comprising: 

- receiving means for receiving a composite color television signal, comprising 
a chrominance signal being modulated on a sub-carrier which is located in the high- 
frequency part of the frequency spectrum of a luminance signal; and 

- a luminance and color separation filter unit for extracting the luminance 
signal and two color signals from the composite color television signal. 

The invention further relates to a method of extracting a luminance signal and 
two color signals from a composite color television signal, comprising a chrominance signal 
being modulated on a sub-carrier which is located in the high-frequency part of the frequency 
spectrum ofthe luminance signaL 

The invention further relates to a computer program product to be loaded by a 
computer arrangement, comprising instructions to extract a luminance signal and two color 
signals from a composite color television signal, comprising a chrominance signal being 
modulated on a sub-carrier which is located in the high-frequency part ofthe frequency 
spectrum ofthe luminance signal, the computer arrangement comprising processing means 
and a memory. 



With HDTV sets becoming readily available in many markets, digital 
television is rapidly gaining popularity. However, analog television is expected to remain the 
most important television standard for the foreseeable future. With the advent of increasingly 
larger televisions that exhibit significantly higher resolutions, a continued quality 
improvement ofthe decoded analog television signal is desirable. 

Many artifects that continue to exist in analog television are caused by the 
imperfect separation of luminance and chrominance in composite color video signals. This 
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2 20.06.2003 
separation is inquired due to the fact that the chrominance component (C) is transmitted by 
modulating it onto a sub-carrier in the high-frequency part of the luminance, i.e. gray-value 
00 spectrum, as illustrated in Fig. 1. As both components share the same frequency space 
then- separation at the receiver side can only be imperfect and often results in artifacts known 
as cross-color and cross-l umin ance. 

A first type of low-cost PAL and NTSC decoders use horizontal band- 
pass/notch filters for Y/C separation. See pages 428-433 in "Video demystified: a handbook 
for the digital engineer 3rd edition", by K. Jack. Eagle Rock: LLH Technical Pubhsbing 
2001. ISBN 1-878707-56-6. H^^ 

the chrorninance, but attenuates the high-frequency luminance as well. Similarly, the band- 
pass filter in the chrominance path passes the chrominance, but also passes the high- 
frequency luminance. Hence, these decoders suffer from a loss of horizontal luminance 
resolution and strong cross-luminance and cross-color artifacts. 

A second type, more advanced decoders aim at an improved Y/C separation by 
using so called comb-filters. See e.g. the article "Three-dimensional pre- and post-filtering 
for PAL TV signals", by D. Teichner, in IEEE Transactions in Consumer Electronics Vol 
34 (1988), No. 1, pp. 205-227. This type of decoders exploit the opposite sub-carrier phase of 
certain vertically or temporally adjacent samples to separate the luminance from the 
chrominance. The basic principle can be explained by taking a composite PAL sample, F t 
that is encoded at an arbitrary phase <|> : 

F, = Y+Usin®) + V cos(<|>) (1) 
and a second sample F 2 encoded at 180°+<|>, of which it is assumed that it was encoded 
from identical luminance and chrominance values: 

F 2 = r+i/sin(<l> +180°) + Vcosty +180°) 
25 Fx = y~ Usm®) - F cos(<|>) 

Now, the addition of F l and F 2 and subsequent division by two results in the separated 
luminance Y, whereas the subtraction and subsequent division by two yields the modulated 
chrominance L/sin(«>) + V cos®) . This means that perfect Y/C separation is possible if F t 
and F 2 were indeed encoded from highly correlated YUV values. 
30 Current state-of-the-art comb-filters adaptively combine various spatial and 

temporal comb-filters by filtering along the direction of the highest detected correlation See 
pages 115-118 in "Video-Signalverarbeitung", by C. Hentschel. Stuttgart Teubner, 1998 
ISBN 3-519-06250-X. (See also Fig. 2). However, particularly in vertically detailed and/or 
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moving areas, the available comb-filtering directions are often too limited due to the required 
opposite sub-carrier phase. As such, even modem 3D comb-filters suffer from cross-talk 
artifacts and loss of resolution. 



It is an object of the invention to provide a filter unit of the kind described in 
the opening paragraph with an improved luminance and color separation. 

This object of the invention is achieved in that the filter unit comprises: 

- acquisition means to acquire a first sample of the composite color television 
signal, corresponding to a first pixel and other samples of the composite color television 
signal, corresponding to other pixels in a neighborhood of the first pixel; 

- correlation estimation means to estimate a first set of correlation values 
representing correlations between the first sample and the respective other samples, on basis 
of an initial separation of an approximation of the luminance signal from the composite color 
television signal; 

- penalty estimation means to estimate a second set of penalty values 
representing relations between the first sample and the respective other samples; 

- computing means to compute a third set of combined values by means of 
combining respective elements of the first set of correlation values and the second set of 
penalty values; 

- selection means to select a particular sample of the composite color 
television signal on basis of the corresponding combined value compared to further combined 
values of the third set of combined values; and 

- decoding means to determine at least one final value of a set of values 
comprising a final luminance value and two color values corresponding to the first pixel on 
basis of the first sample and the particular sample. 

to prior art filter units, e.g. based on comb-filters, the selected decoding option, i.e. Ihe 
particular sample, is only based on the correlation between the first sample and the particular 
sample. For the Y/C separation of the first sample in a standard two sample filter unit, an 
additional sample, with a predetermined sub-carrier phase difference compared to me first 
sample, is required. However the number of samples fulfilling that condition is relatively 
limited. Besides that, often, e.g. in the case of much image detail or motion, the actual 
correlation between the first sample and the particular sample is relatively small. 
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In the filter unit according to the invention, a more general approach is used hy 
applymg an extended set of candidate samples, i.e. decoding options. The selection of the 
most appropriate sample, i.e. the particular sample, is based on the correlation between me 
two first sample and the particular sample and based on a corresponding penalty value 
Therefore, the first sample and the particular sample corresponding to apixel within a 
predetermined spatial or temporal neighborhood of the pixel, corresponding to the first 
sample, are used as input for the two sample filter unit The underlying principle of the filter 
unit according to the invention is that comb-filtering is most desirable on samples mat exhibit 
the highest correspondence, regardless of their exact spatial or temporal direction. That 
means that there is a Ixade-off between a strict phase requirement, e.g. 180° difference, and 
correlation. E.g. a particular sample and the first sample might have non-opposite sub-carries 
phases, but a difference of sub-carries phases of e.g. 170° . In that case the particular sample 
might be chosen because of its high correlation value, although the difference of sub-carries 
phases is 170° . This approach offers a significant increase in decoding options, and thereby 
1 5 promises an increase in decoding quality. 

In an embodiment according to the invention, the correlation estimation means 
is arranged to compute a first one of the correlation values by means of computing a 
difference between a first luminance value and a second luminance value, the first luminance 
value belonging to the first pixel and being represented by a first sample of the 
approximation of the luminance signal, the second luminance value belonging to a second 
one of the pixels in the neighborhood of the firstpixel and being represented by a second 
sample of the approximation of the luminance signal. Alternatively, chrominance values are 
applied to estimate the first one of the correlation values. The approximation of the 
luminance signal is obtained by means of an initial Y/C separation being performed by an 
initial separation filter. This initial separation filter might be based on any known type of Y/C 
separation filter as discussed above, e.g. a horizontal band-pass/noteh filters or a known 
comb-filter. 

In an embodiment according to the invention, the penalty estimation means is 
arranged to compute a first one of the penalty values by means of computing a distance 
between the firstpixel and a second one of the pixels in the neighborhood of the firstpixel. 
The distance between pixels is an appropriate measure to determine the appropriateness of 
the corresponding samples to be applied for Y/C separation. The bigger the temporal or 
spatial difference the less appropriate the sample. 
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In an embodiment according to the invention, the penalty estimation means is 
arranged to compute a first one of the penalty values by means of: 

- computing a first difference between a first sub-carrier phase of the first 
sample of the composite color television signal, corresponding to the first pixel and a second 
sub-carrier phase of a first one of the other samples corresponding to other pixels in the 
neighborhood of the first pixel; and 

- computing a second difference between the first difference and a 
predetermined value. 

For a two-sample filter unit the predetermined value corresponds tol80° . For a three-sample 
filter unit Ihe predetermined value corresponds to 120° . In the latter case the decoding means 
are arranged to determine the final luminance value and the two color values corresponding 
to the first pixel on basis of the first sample, the particular sample and a further one of the 
other samples corresponding to other pixels in a neighborhood of the first pixel. The 
deviation from the optimum sub-carrier phase is a relatively good measure to determine the 
appropriateness of the corresponding samples to be applied for Y/C separation. The 
computation of the deviation from the optimum sub-carrier phase is straightforward. 

In an embodiment according to the invention the other pixels in the 
neighborhood of the first pixel are located in a window which is centered around Ihe first 
pixel and located in a first field to which the first pixel belongs. Alternatively, a first portion 
of the other pixels in the neighborhood of the first pixel are located in a first window which is 
centered around the first pixel and located in a first field to which the first pixel belongs and a 
second portion of the other pixels in the neighborhood of the first pixel are located in a 
second window which is located in a second field. The second window is centered around a 
central pixel A first option is that the first pixel and the central pixel have mutually equal 
coordinates. A second option is that the first pixel and the central pixel are located along a 
motion trajectory. That means that the difference between the coordinates of the first pixel 
and the coordinates of the central pixel are determined by a motion vector, representing 
motion between parts of the first and second field. An advantage of applying multiple 
windows corresponding to multiple fields is that the probability of selecting an appropriate 
particular sample is relatively high. 

It is a further object of the invention to provide an image processing apparatus 
of the kind described in the opening paragraph with an improved luminance and color 
separation. 

This object of the invention is achieved in that the filter unit comprises: 
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- acquisition means to acquire a first sample of the composite color television 
signal, corresponding to a first pixel and other samples of the composite color television 
signal, corresponding to other pixels in a neighborhood of the first pixel; 

- correlation estimation means to estimate a first set of correlation values 
representing correlations between the first sample and the respective other samples, on basis 
of an initial separation of an approximation of the luminance signal from the composite color 
television signal; 

- penalty estimation means to estimate a second set of penalty values 
representing relations between the first sample and the respective other samples; 

- computing means to compute a third set of combined values by means of 
combining respective elements of the first set of correlation values and Ihe second set of 
penalty values; 

- selection means to select a particular sample of Ihe composite color 
television signal on basis of toe corresponding combined value compared to further combined 
values of the third set of combined values; and 

- decoding means to detennine at least one final value of a set of values 
comprising a final luminance value and two color values corresponding to the first pixel on 
basis of the first sample and the particular sample. 

Optionally, the image processing apparatus comprises a display device for displaying images 
being represented by toe luminance signal and the two color signals. The image processing 
apparatus might be a TV. 

It is a further object of toe invention to provide a method of the kind described 
in the opening paragraph resulting in an improved luminance and color separation. 

This object of the invention is achieved in that the method comprises: 

- acquiring a first sample of the composite color television signal, 
corresponding to a first pixel and other samples of the composite color television signal, 
corresponding to other pixels in a neighborhood of toe first pixel; 

- estimating a first set of correlation values representing correlations between 
the first sample and the respective other samples, on basis of an initial separation of an 
approximation of the luminance signal from the composite color television signal; 

- estimating a second set of penalty values representing relations between the 
first sample and the respective other samples; 

- computing a third set of combined values by means of combining respective 
elements of the first set of correlation values and the second set of penalty values; 
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- selecting a particular sample of the composite color television signal on basis 
of the corresponding combined value compared to further combined values of the third set of 
combined values; and 

- determining at least one final value of a set of values comprising a final 
lummance value and two color values corresponding to the first pixel on basis of the first 
sample and the particular sample. 

It is a further object of the invention to provide a computer program product of 
the kind described in the opening paragraph resulting in an improved luminance and color 
separation. 

This object of the invention is achieved in that, the computer program product, 
after bemg loaded, provides said processing means with the capability to carry out: 

- acquiring a first sample of the composite color television signal, 
corresponding to a first pixel and other samples of the composite color television signal 
corresponding to other pixels in a neighborhood of the first pixel; 

- estimating a first set of correlation values representing correlations between 
the first sample and the respective other samples, on basis of an initial separation of an 
approximation of the luminance signal from the composite color television signal; 

- estimating a second set of penalty values representing relations between the 
first sample and the respective other samples; 

- computing a third set of combined values by means of combining respective 
elements of the first set of correlation values and the second set of penalty values; 

- selecting aparticular sample of the composite color television signal on basis 
of the corresponding combined value compared to further combined values of the third set of 
combined values; and 

- determining at least one final value of a set of values comprising a final 
lummance value and two color values cormsponding to the firstpixel on basis of the first 
sample and the particular sample. 

Modifications of the filter unit and variations thereof may correspond to 
modifications and variations thereof of the melhod described. 



' md 0ther aSpects of *» filter mfc of the image processing apparatus, of 
the method and of the computer program product according to the invention will become 
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apparent from and will be elucidated with respect to the implementations and embodiments 
described hereinafter and with reference to the accompanying drawings, wherein; 

Fig. 1 schematically shows a spectrum of a composite PAL video signal; 

Fig. 2 schematically show sub-carrier phases of samples in adjacent video 
lines for successive fields; 

Fig. 3 schematically shows an embodiment of a filter unit according to the 

invention; 

Fig. 4 schematically shows another embodiment of a filter unit according to 
the invention which is based on a three sample decoding scheme; 

Fig. 5 A schematically shows candidate windows in the next, cuiTent and 
previous fields at fixed position; 

Fig. 5B schematically shows candidate windows in the next, current and 
previous fields at motion compensated position; 

Fig. 6 schematically shows another embodiment of a filter unit according to 
the invention which is arranged to derive the luminance signal from decoded chrominance; 
and 

Fig. 7 schematically shows an image processing apparatus according to the 

invention. 

Same reference numerals are used to denote similar parts throughout the figs.. 

Fig. 1 schematically shows a spectrum of a composite PAL video signal. 

In order to comprehend the problems involved in Y/C separation, one has to 
understand the standards for the transmission of analog color television signals, such as the 
PAL, NTSC and SECAM standards described in ITU-R BT.470. For these standards, the 
requirement of backward compatibility to existing black-and-white televisions dictates that 
the transmission of chrominance (C) has to take place within the band available for the gray- 
scales (Y). 

For PAL, the chrominance components U and V are amplitude modulated in 
quadrature onto a sub-carrier frequency of 4.43MHz. The resulting one-dimensional 
spectrum of the composite PAL video signal is illustrated in Fig. 1. In addition, the sign of 
the V-component, the so-called V-switch, is inverted every other line to reduce the influence 
of phase errors. More formally, the above is described in Equation 3, where x indicates the 
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pixel position in a given field n , F K the sub-carrier frequency and F the re 
PAL signal. 

F(x,n) = r(^») + ^(x,/i)sin(27cF, c /)±F(^»)cos(27cF ie O 
For NTSC, the somewhat differently defined chrominance co 
Q are amplitude modulated in quadrature onto a sub-carrier frequency of 3.f 
alternating sign is applied to either chrominance component, there is an incr 
to phase errors that can result in an erroneous hue of the decoded picture. Tl 
dimensional spectrum is similar to that of PAL, except that now the availabl 
bandwidth is limited to approximately 4.2MHz. Equation 4 formally definei 

F(x,n) = Y(x,n) +I(x t n)wa(2jtF te t) +Q(x,ri)cos(2nF Jc t) 
The remainder of mis specification discusses the Y/C separation of PAL coi 
video signals. However, the Y/C separation of NTSC signals is nearly identi 
described separation of PAL signals with equal V-switehes. First a short des 
art Y/C separation filters is provided. 

At the television receiver, the required separation of Y and C 
imperfect as both components share the same frequency space. The early de 
and NTSC composite video signals used two simple one-dimensional horizc 
separate luminance and chrominance from the composite signal, These filtei 
notch and band-pass filters. 

In the luminance path, a notch filter suppresses frequencies n 
carrier frequency to eliminate horizontal chrominance components. Due to t 
band of the notch filter, high-frequency chrominance components, as they o 
horizontal colored transitions, will be insufficiently attenuated. This introdu 
from chrominance to luminance, resulting in the so-called cross-luminance i. 
Furthermore, the luminance resolution is significantly reduced, as the notch 
any luminance components in the stop-band. 

In the chrominance path, a band-pass filter separates the high 
components from the composite signal. Although the pass-band of the band 
contains mostly chrominance information, high-frequency luminance is pres 
Again, cross-talk will occur as the high-frequency luminance will be decode 
chrominance, resulting in the so-called cross-color artifacts. 

The band-pass and notch filters can achieve perfect Y/C sepa 
luminance and chrominance values of horizontally adjacent samples are idei 
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fiequency spectrum consists of a DC luminance component and a chrominance component at 
the sub-carrier frequency. However, if the correlation along the horizontal axis is insufficient, 
the frequency spectrum contains high-frequency luminance and/or chrominance components 
The horizontal separation is now imperfect and results in cross-talk artifacts in the decoded 



In areas where horizontally adjacent samples are insufficiently correlated, 
additional methods for Y/C separation are desirable. For that purpose, so-called comb-filters 
can be used to separate luminance and chrominance along the vertical or temporal axis Their 
underlying principles are similar to those of the standard decoder, i.e. passing the desired 
frequency components and suppressing the undesired frequency components. 

However, the luminance and chrominance are now modulated with harmonics 
of f h , i.e. the line frequency, and f v , i.e. the picture frequency. Along with the chosen sub- 
carrier frequencies of PAL and NTSC, this results in interleaved and non-overlapping 
lummance and chrominance frequency components in the direction where sufficient 
correlation is present For example, in non-moving areas of the picture, the samples are 
highly correlated along the temporal axis, and as such, the luminance and chmrninance 
components are interleaved and non-overlapping along that axis. A filter with a comb-shaped 
amplitude response in that particular direction can therefore be used to separate the 
lu min a n ce and chrominance. 

A typical comb-filter implementation uses two samples with an opposite 
relative phases, i.e. having a phase difference of 180°to separate luminance and 
chrominance. See Equations 1 and 2. 

However, perfect separation is only possible if both composite samples were 
encoded fiom identical Y, U and V value, Only in tms case, me positions of me luminance 
and chrominance frequency components correspond to those of the comb-filter. Therefore 
sufficient correlation is required along the comb-filtering direction in order to prevent 
decoding errors. This is analogous to the horizontal band-pass/notch filters, where sufficient 
correlation is required along the horizontal axis. 

An inherent drawback of the standard comb-filter is the low density of 
samples that both meet the required phase relationship, and are spatially and/or temporally 
adjacent Due to this limited set of samples, situations will occur where neither of the 
neighboring samples exhibit sufficient correlation with respect to the current sample, thereby 
causing artifacts in the decoded video. 
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Fig. 2 schematically show sub-carrier phases of samples 202, 204, 208, 210 
214 and 216 in adjacent video lines 313, 1, 314, 2, 315 and 3 for successive fields 1A, IB,' 
2A, 2B, 3 A, 3B and 4A. Here, the arrow equals the sub-carrier phase, e.g. pointing up 
denotes 0°and to the right denotes 90° . Besides that, pairs of samples 206, 212 and 218 are 
depicted which are used for standard comb -filters: 

- the pair 206 of samples 202 and 204 correspond to a line comb-filter; 

- the pair 212 of samples 208 and 210 correspond to a frame comb-filter, and 

- the pair 218 of samples 214 and 216 correspond to a field comb-filter. 

Fig. 3 schematically shows an embodiment of a filter unit 300 according to the 
invention. In particular Fig. 3 schematically shows a PAL decoder. The filter unit 300 is 
provided wim a composite color television signal CVBS, comprising a crjominance signal 
being modulated on a sub-carrier which is located in the high-frequency part of the frequency 
spectrum of the luminance signal. The output of the filter unit 300 comprises a luminance 
signal Y , a first color signal U and a second color signal V . The filter unit 300 comprises: 

- an acquisition unit 302 to acquire a first sample of the composite color 
television signal, corresponding to a first pixel and other samples of the composite color 
television signal, corresponding to other pixels in a neighborhood of the first pixel; 

- a correlation estimation unit 304 to estimate a first set of correlation values 
representing correlations between the first sample and the respective other samples, on basis 
of an initial separation of an approximation of the luminance signal from thexomposite color 
television signal; 

- a penalty estimation unit 306 to estimate a second set of penalty values 
representing relations between the first sample and the respective other samples; 

- a computing unit 308 to compute a third set of combined values by means of 
combining respective elements of the first set of correlation values and the second set of 
penalty values; 

- a selection unit 310 to select aparticular sample of the composite color 
television signal on basis of the corresponding combined value compared to further combined 
values of the third set of combined values; 

- a decoding unit 312 to determine at least one final value of a set of values 
comprising a final luminance value and two color values corresponding to the first pixel on 
basis of the first sample and the particular sample. This decoding unit might be any known 
type of PAL decoding filter, e.g. based on a comb-filter, and 

- an initial separation filter 314. 
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The sample acquisition unit 302, the correlation estimation unit 304, penalty 
estimation unit 306, the computingunit 308, the selection unit 310, the deeding unit 312 and 
the initial separation filter 3 14 may he implemented using one processor. Normally, these 
functions are performed under control of a software program product. During execution, 
normally the software program product is loaded into a memory, like a RAM, and executed 
from there. The program may be loaded from a background memory, like a ROM, hard disk, 
or magnetically and/or optical storage, or may be loaded via a network like Internet. 
Optionally an application specific integrated circuit provides the disclosed functionality. 

Next Ihe working of the filter unit 300 according to the invention will be 
explained. An important aspect of the filter unit 300 is the selection of related samples. This 
selection is based upon characteristics of the composite color television signal CVBS. hi this 
case the selection is performed on a per-sample basis. That means that for every first sample 
to be decoded, the most suitable additional sample, i.e. the particular sample is chosen. The 
most suitable sample is determined by: 

- the correlation value, being computed by the correlation estimation unit 304, 
as insufficiently correlated samples yield decoding errors; and 

- the penalty value, being computed by the penalty estimation unit 306. The 
penalty is based on a phase measurement and optionally a distance measurement Spatially 
and/or temporally adjacent samples are generally expected to have a higher correlation to the 
current sample than non-adjacent samples. As such, larger spatial and/or temporal distances 
should be avoided. 

With phase, optionally distance and correlation information available, a straightforward 
approach is to apply the criteria to spatially and/or temporally adjacent samples: the so-called 
candidate set, which is generated by means of the acquisition unit 302. The optimum sample 
or candidate, being selected by means of the selection unit 310 wilhin that candidate set serve 
as input to the decoding unit 3 12, thereby decoding the current CVBS sample. 

However, determining the correlation between samples constitutes a chicken- 
or-the-egg problem: in order to decode the color television signal CVBS, one needs to know 
the correlation between samples, which in turn is only available after decoding. To break this 
cycle, the filtering is initialized by an initial separation, which is performed by the initial 
separation filter 3 14 which is based on e.g. a combination of horizontal band-pass/notch 
filters. Even though this initial separation is far from perfect, experimental validation has 
shown its suitability for this purpose. 
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The exact size of the candidate window is determined by the horizontal and 
vertical boundaries / x and t y , as shown in Equation 5. Again, F(x,n) is the composite sample 
at the pixel position x in a given field n . 



x + 



with: 



(5) 
(6) 



(7) 



If only spatial candidates are used, Le. m = 0 , this leads to Equation 7, i.e. the complete 
candidate set CS equals the spatial candidate set C(x,n) . 
CS={c£,n)} 

However, CS might be composed of spatial as well as temporal candidates. 
For example, consider the candidate set shown in Equation 8 and Fig. 5A, where candidates 
originate from candidate windows in the previous, current and next field. 

cs = {c^,/z+i}cfc„}c^,»-i)} • 

W 

As opposed to temporal windows centered around the current spatial position, 
motion compensation is preferably used to increase the correlation of temporal candidates by 
positioning the candidate windows along the motion axis. This is illustrated in Equation 9 
and Fig. 5B, where Z>(x,«) describes the displacement of the sample at pixel position xina 

filed field n to field n + 1 . The displacement from field n to n - 1 is assumed to be - Z>(J, ») , 
i.e. linear movement 







U+i}" 


cs = 


C\x,n) 






C$p-m?t,n, 


U-i) 

J 



(9) 

Due to the increase in latency, comb-filters using a next field can be 
undesirable. Therefore, various configurations are possible using only previous fields. Three 
examples are illustrated in Equation 10, where respectively frame and field, field only and 
frame only comb-filters are specified. 
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CS=fck„)ck»-l)ck»-2)} 

cs={cfc„}cfe„-i)} 

cs={cfcn)cfc„- 2 )} (10) 

The computation of the combined value, based on the correlation and phase is 
as follows. Given a candidate set CS of CSMAX candidates, a combined value is assigned to 
each candidate as a function of both the phase relationship and the correlation to the current 
sample. This is shown in Equation 11, where the combined value e f is calculated for the 

respective candidates CS,with *. {/, CSMAX} . The combined value equals the weighted 

sum ofthe correlation value L(CS it F t ) and the phase penalty P{CS t ) where a, and 
<x 2 correspond to the respective weighting factors: 

e,(GS„ J F;)=a 1 ■L{cS t ,F l )+a 2 ife) 

*«*fc») (12) 
The correlation value is calculated in a straightforward manner as the absolute 
difference ofthe initially separated luminance values, as shown in Equation 13. 

(13) 

The bas 1C idea behind the phase penalty is that the phase differences that result 
in no amplication of correlation noise should yield the lowest penalty. For the two sample 
comb-filter kernel, the situation is simplified as strict phase requirements exist In the case of 
identical V-switohes, a two sample comb-filter requires an opposite relative phase, i e a 
difference of 180°, whereas in case of non-identical V-switches, comb-filtering using two 
samples is only possible if the samples' absolute phases are opposite. 

First, the sub-carrier phase of F t is specified as Ztf). The normalized phase 
difference P n which transforms the relative phase 0 from [0,27c] is determined according to: 



( 

A = 



fi ,else 

(14) 

Then the phase penalty for samples with identical V-switehes can be defined: 
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P(CS,) = . 



(15) 



0 ,if A =7C 

1 y else 

In turn, the phase penalty for samples with non-identical V-switches is: 

P(GS,)=[o »'/ 4cS t )=-z{F,) 
1 ,else 

(16) 

Having determined the penalties for the CSMAX candidates within candidate set CS , the 
optimum candidate, i.e. the one with the lowest combined value, will be selected as the 
particular sample F 2 . Both F t and F 2 can now be decoded by the two sample comb-filter 
kernel, i.e. the decoding unit 312. 

Optionally the filter unit 300 comprises an up-sampling unit 3 16 which is 
designed to achieve an increased density of the sampling grid by means of interpolation. 
Within a certain spatial distance, now * times as many candidates are available in 
comparison to the original sampling grid, with *being the up-sampling factor. Therefore, the 
amount of candidates has increased, whereas a deterioration of correlation due to increased 
spatial distance has been avoided. 

Besides decoding based on two samples, there are decoding techniques based 
on three samples. A filter unit according to the invention of this latter type is described in 
connection with Fig. 4. First the decoding based on three samples is explained and then the 
method of selecting three appropriate samples. 

Fig. 4 schematically shows another embodiment of a filter unit according to 
the invention, which is based on a three sample decoding scheme. The filter unit 400 is 
provided with a composite color television signal CVBS, comprising a chrorninance signal 
being modulated on a sub-carrier which is located in the high-frequency part of the frequency 
spectrum of Ihe luminance signal. The output of the filter unit 400 comprises a luminance 
signal Y , a first color signal U and a second color signal V . The filter unit 400 comprises: 
- a sample acquisition unit 402 which is arranged to acquire a first F, , a second F 2 and a third 
F 3 sample from the received composite color television signal CVBS and to regenerate three 
signals a , p and y corresponding to the sub-carrier used for encoding of the video data; 

- a first processing unit 404 for computing a first intermediate signal Y n ; 

- a second processing unit 406 for computing a second intermediate signal U n ; 

- a third processing unit 408 for computing a third intermediate signal V„ ; 
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- a fourth processing unit 410 for computing a fourth intermediate signal E ; 

and 

- a division unit 412 for computing the luminance signal Y , the first color 
signal U and the second color signal V on hasis of the intermediate signals Y a ,U , V and 
E. 

The filter unit 400 is arranged to compute an output luminance value of a 
particular output pixel, a first color value of the particular output pixel and a second color 
value of the particular output pixel on hasis a first F t , a second F 2 and a third F 3 sample 
derived from the composite color television signal CVBS, where the first, the second and the 
third sample have mutually different suh-carrier phases. 

A received composite sample, F(x,n) introduces three unknown variables, 
namely the values of Y, U and V, and one known value, i.e. the locally regenerated sub- 
carrier phase cat . Basic algebra shows that, given three linear equations, these three unknown 
variables can be solved. This means that three composite samples, encoded from Y, U and V 
values, can be used to separate the Y, U and V components exactly. However, in the situation 
that the composite samples were encoded from non-identical Y, U and V values, perfect 
separation is not possible and errors in the decoded values will occur. 

To discuss the decoding of samples with non-opposite phases in more detail, 
two situation with respect to the V-switch of three composite samples should be considered: 

- The V-switch of all three samples is identical; or 

- One of the three samples has an unequal V-switch with respect to the other 

samples. 

Therefore a distinction between the decoding of samples with identical V- 
switches, and the decoding of samples with non-identical V-switches is made. Although the 
following calculations are applicable to PAL signals, identical principles apply to NTSC as to 
PAL signals with identical V-switches. Then, the chrominance components I and Q are used 
instead of U and V. 

In the case of identical V-switches, consider three composite samples encoded 
from the same Y, U and V values as shown in Equation 17. In order to obtain three 
independent equations, the phases were chosen to be unequal, i.e. a * 0 * y . Also, the V- 
switch of all V components is chosen to be positive. In the case of all negative V-switches, 
the situation is identical expect for an inversion of the sign of the decoded V component 
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F, =r+j7. s in(a)+Kcos(a) 

F 2 =T+Usm(j)+Vcos{jS) (17) 
F 3 = Y+ U ■ sin(Y)+ V • cos(y) 

By solving these three linear equations for the Y, U and V components, the expressions in 
Equations 1 8 and 19 are obtained. Here, the Y, U and V components are expressed in terms 
of the three original composite samples and their corresponding sub-carrier phase. 
+F t sin(^) cos(Y)-^ • shift )cos(/?) 
Y„=+F 2 sin(y) cos(a)-F 2 sin(a)-cos(y) 
+ F 3 ■ sin(a ) • cos(yff)- F 3 • sin^S) • cos(a ) 

v +F t cos(ft)-F i cos(y)+F 2 cos(y) 
* - F 2 ■ cos(a)+F 3 • cos(a)-F 3 • cos{fi) 



V n = 



F x • sin(Y)- F t ■ sm(j$)+F 2 • sin(a) 
- F 2 ■ sin(Y ) + F 3 • sinOff)- F 3 • sin(a ) 



+ sin(a ) • cosOff) - sin(a ) • cos(y ) 
E=+sin(^)-cos(Y)-sinGff)cos(a) (i 8 ) 
+sin(Y)- cos(a)-sin(Y)- cos(ft) 



with: 



A similar calculation can be performed for samples with non-identical V- 
switches. Two situations can be distinguished: 

- The V-switch of one composite sample is positive, whereas the remaining 
samples have a negative V-switch; or 

- The V-switch of one composite sample is negative, whereas the remaining 
samples have a positive V-switch 

The first situation is shown in Equation 20, whereas the second situation will not be covered, 
as it is identical except for an inversion in sign of the decoded V component 
F x =F+t/sin(a)+Fcos(a) 

F 2 =Y+Usm(ft)+Vcos(j3) (20) 
F 3 = 7 + U ■ sin(Y ) + V ■ cos(y ) 
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By solving these equations for the Y, U and V components, the expressions depicted in 
Equations 21 and 22 can be obtained. 

+ sin(» cos(Y)-i? sin(y) cos(/?) 
Y n=-F 2 sin(y)cos(a)-F 2 sin(a) cos(y) 
+F 3 sin(a) cosG?)+F 3 . s in(yff) cos(a) 

Ut _ +F i cos(ft)-F l cos(y)+F 2 cos(y) 
n +F 2 cos(a)-F 3 cos(a)-F 3 cos(j3) 



V n = 



_+F t ,sin(^)-i5; sin(y)+F 2 sin(y) 
-F 2 sin(a) + F 3 sin(a)-F 3 sin(>) 



10 With: 



+ sin(a)- cos(yff)- sin(a)- cos(y) 
E=+ sin(»- cos(y )+sin(yff)- cos(a) 
- sin(y )• cos(a)-sin(y )• cos(>?) 



E E 



E 



(21) 



(22) 



is 



Next the computation of penalty values in the case of three samples it 
specified. In the case of identical V-switches the phase penalty value is specified by 
15 Equation 23: 



P(CS l ) = - 



0 

3 A -2k 



k 

2tc-3A 



n 



,if fin =n 

,1/ — <fi n >% 

,else 



(23) 



In the case of non-identical V-switches the phase penalty value is specified i 
Equation 25 for 0 < a <; | , whereas the penalty for the other three quadrants, i.e. between 



% 3k 



— ,7t,— and 27t can be mapped to the first quadrant by means of a„ 
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2n -a 
a -7c 
7c -a 
a 



19 

,*/ — <a <2tc 

,1/ 7c<a< — 
2 

,*/ —<a<7c 
,else 
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(24) 



i > (C5 1 ) = 



0 

3 A -27C 



7U 

27C-3A 



7C 



,*/ A=* 
.•r f <A*f 



(25) 



with: 



10 



15 



51 



71 



r 7C 



2*^2 A I <A<27C " 



(26) 



Fig. 6 schematically shows another embodiment of a filter unit according to 
the invention which is arranged to derive the luminance signal from decoded chrominance. 
The filter unit 600 according to the invention comprises: 

- a first low pass filter 602 for filtering a first U one of the two color signals; 

- a second low pass filter 604 for filtering a second V one of the two color 

signals; 

- a modulator 606 connected to the first low pass filter 602 and the second low 
pass filter 604, for re-modulating the filtered first one of the two color signals and the 
filtered second Vjj, f one of the two color signals; and 

- a subtraction unit 608 for subtracting the output of the modulator 606 from 
the composite color television signal CVBS, resulting in a luminance signal Y . 
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The first 602 and second low pass filter 604 have a characteristic which matches me low pass 
filters being applied in PAL encoders, i.e. 1.3MHz and the modulator 606 is arranged to 
modulate with a sub-carrier being applied in PAL encoders. In this embodiment according to 
the invention the two filtered color signals U„ and V„ F do not or hardly comprise 
fluency components which were not present in the original color signals before encoding 
Furthermore, the luminance signal also better matches the original luminance signal before 
encoding by a video encoding unit, i.e. a PAL encoder. 

A further improvement of the filter unit according to the invention is based on 
dynamic window resizing. Dynamic window resizing can achieve a reduction in 
computational cost and prevent decoding errors due to an erroneous initialization In flat 
areas, i.e. in case of highly correlated samples, the candidate window size will be decreased 
to avoid any errors due to inaccuracies in the initialization. In areas with a significant amount 
of detail, an enlargement of the window size is necessary to ensure sufficient correlated 
candidates are available to the comb-filter. 

Fig. 7 schematically shows an image processing apparatus 700 according to 
the invention, comprising: 

- Receiving means 302 for receiving a signal representing input images. 

- The filter unit 706 as described in connection with any of the Figs. 3, 4 

and 6; and 

- A display device 704 for displaying images being represented by the 
luminance signal and the two color signals. 

The signal may be a broadcast signal received via an antenna or cable but may also be a 
signal from a storage device like a VCR (Video Cassette Recorder) or Digital Versatile Disk 
(DVD). The signal is provided at the input connector 710. The image processing apparatus 
700 might e.g. be a TV. Alternatively the image processing apparatus 704 does not comprise 
the optional display device but provides the output images to an apparatus that does comprise 
a display device 704. Then the image processing apparatus 700 might be e.g. a VCR player. 
Optionally the image processing apparatus 700 comprises storage means, like a hard-disk or 
means for storage on removable media, e.g. optical disks. 

It should be noted lhat the above-mentioned embodiments illustrate rather than 
limit the invention and that those skilled in the art will be able to design alternative 
embodiments without departing from the scope of the appended claims. In the claims any 
reference signs placed between parentheses shall not be constructed as limiting the claim 
The word 'comprising' does not exclude the presence of elements or steps not listed in 
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claim. The word "a" or "an" preceding an element does not exclude the presence of a 
plurality of such elements. The invention can be implemented by means of hardware 
comprising several distinct elements and by means of a suitable programmed computer. In 
the unit claims enumerating several means, several of these means can be embodied by one 
and the same item of hardware. 
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CLAIMS: 



10 



1. A luminance and color separation filter unit (300) for extracting a luminance 

signal ( 7 ) and two color signals (U,V)&oma composite color television signal (CVBS) 
comprising a chxominance ( C) signal being modulated on a sub-carrier which is located in 
the bigh-fieoueney part of the frequency spectrum of the luminance signal ( Y ), the filter unit 
(300) comprising: 

- acquisition means (302) to acquire a first sample of the composite color 
television signal, corresponding to a first pixel and other samples of the composite color 
television signal, corresponding to other pixels in a neighborhood of the first pixel; 

- correlation estimation means (304) to estimate a first set of correlation values 
representing correlations between me first sample and the respective other samples, on basis 
of an nutial separation of an approximation of me luminance signal from the composite color 
television signal; 

- penalty estimation means (306) to estimate a second set of penalty values 
representing relations between the first sample and the respective other samples; 

- computing means (308) to compute a third set of combined values by means 
of combining respective elements of the first set of correlation values and the second set of 
penalty values; 

- selection means (310) to select a particular sample of the composite color 
television signal onbasis of the corresponding combined value compared to further combined 

20 values of the third set of combined values; and 

- decoding means (3 12) to determine at least one final value of a set of values 
comprising a final luminance value and two color values corresponomg to the first pixel, on 
basis of the first sample and the particular sample. 



15 



25 



2. A luminance and color separation filter unit (300) as claimed in claim 1 

whereby the correlation estimation means (304) is arranged to compute a first one of the 
correlation values by means of computing a difference between a first luminance value and a 
second luminance value, the first luminance value belonging to the first pixel and being 
representedby a first sample of the approximation of the luminance signal, the second 
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luminance value belonging to a second one of the pixels in the neighborhood of the first pixel 
and being represented by a second sample of the approximation of the luminance signal. 

3. A luminance and color separation filter unit (300) as claimed in claim 1 , 
whereby the penalty estimation means (306) is arranged to compute a first one of the penalty 
values by means of computing a distance between the first pixel and a second one of the 
pixels in the neighborhood of the first pixel. 

4. A luminance and color separation filter unit (300) as claimed in claim 1 , 
whereby the penalty estimation means (306) is arranged to compute a first one of the penalty 
values by means of: 

- computing a first difference between a first sub -carrier phase of the first 
sample of the composite color television signal, corresponding to the first pixel and a second 
sub -carrier phase of a first one of the other samples corresponding to other pixels 
in the neighborhood of toe first pixel; and 

- computing a second difference between the first difference and a 
predetermined value. 

5. A luminance and color separation filter unit (300) as claimed in claim 4, 
whereby the predetermined value corresponds to 180° . 

6. A luminance and color separation filter unit (300) as claimed in claim 4, 
whereby the predetermined value corresponds to 120° and the decoding means (3 12) are 
arranged to determine toe at least one final value of the set of values comprising the final 
luminance value and the two color values corresponding to the first pixel, on basis of the first 
sample, toe particular sample and a further one of toe other samples corresponding to other 
pixels in a neighborhood of the first pixel. 

7 - A luminance and color separation filter unit (300) as claimed in claim 1 , 

whereby toe other pixels in the neighborhood of toe first pixel are located in a window which 
is centered around the first pixel and located in a first field to which toe first pixel belongs. 

8. A luminance and color separation filter unit (300) as claimed in claim 1 , 

whereby a first portion of the other pixels in the neighborhood of the first pixel are located in 
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a first window which is centered around the first pixel and located in a first field to which the 
first pixel belongs and a second portion of the other pixels in the neighborhood of the first 
pixel are located in a second window which is located in a second field 

9. A luminance and color separation filter unit (300) as claimed in claim 8, 
whereby the second window is centered around a central pixel, the first pixel and the central 
pixel having mutually equal coordinates. 

10. A luminance and color separation filter unit (300) as claimed in claim 8, 
whereby the second window is centered around a central pixel, me difference between the 
coordinates of the first pixel and the coordinates of the central pixel determined by a motion 
vector, representing motion between parts of the first and second field. 

11. An image processing apparatus (700) comprising: 

- receiving means (702) for receiving a composite color television signal, 
comprising a chrominance signal being modulated on a sub -carrier which is located in the 
high -frequency part of the frequency spectrum of a luminance signal; and 

- a luminance and color separation filter unit (706) for extracting the 
luminance signal and two color signals from the composite color television signal, the filter 
unit (706) comprising: 

* acquisition means (302) to acquire a first sample of the composite color 
television signal, corresponding to a first pixel and other samples of the composite color 
television signal, corresponding to other pixels in a neighborhood of the first pixel; 

* correlation estimation means (304) to estimate a first set of correlation 
values representing correlations between the first sample and the respective other samples, 
basis of an initial separation of an approximation of the luininance signal from the composite 
color television signal; 

* penalty estimation means (306) to estimate a second set of penalty values 
representing relations between the first sample and the respective other samples; 

* computing means (308) to compute a third set of combined values by means 
of combining respective elements of the first set of correlation values and the second set of 
penalty values; 
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* selection means (3 10) to select a particular sample of the composite color 
television signal on basis of the corresponding combined value compared to further combined 
values of the third set of combined values; and 

* decoding means (312) to determine at least one final value of a set of values 
5 comprising a final luminance value and two color values corresponding to the first pixel on 

basis of the first sample and the particular sample. 

12. An image processing apparatus (800) as claimed in claim 1 1, further 
comprising a display device (804) for displaying images being represented by the luminance 

10 signal and the two color signals. 

13. A TV comprising the image processing apparatus (800) as claimed in claim 12 
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14. A method of extracting a luminance signal and two color signals from a 

composite color television signal, comprising a chroniinance signal being modulated on a sub 

-carrier which is located in the high -frequency part of me frequency 
spectrum of the luminance signal, the method comprising: 

- acquiring a first sample of the composite color television signal, 
corresponding to a first pixel and other samples of the composite color television signal, 
corresponding to other pixels in a neighborhood of the first pixel; 

- estimating a first set of correlation values representing correlations between 
me first sample and the respective other samples, on basis of an initial separation of an 
approximation of me luminance signal from the composite color television signal; 

- estimating a second set of penalty values representing relations between me 
first sample and the respective other samples; 

- computing a third set of combined values by means of combining respective 
elements of the first set of correlation values and the second set of penally values; 

- selecting a particular sample of the composite color television signal on basis 
of the corresponding combined value compared to further combined values of the third set of 
combined values; and 

- determining at least one final value of a set of values comprising a final 
luminance value and two color values corresponding to the first pixel on basis of the first 
sample and the particular sample. 
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15. A computer program product to be loaded by a computer arrangement, 

comprising instructions to extract a luminance signal and two color signals from a composite 
color television signal, comprising a chrominance signal being modulated on a sub-carrier 
which is located in the high-fiequency part of the frequency spectrum of the luminance 
signal, the computer arrangement comprising processing means and a memory, the computer 
program product, after being loaded, providing said processing means with the capability to 
cany out: 

- acquiring a first sample of the composite color television signal, 
corresponding to a first pixel and other samples of the composite color television signal, 
corresponding to other pixels in a neighborhood of the first pixel; 

- estimating a first set of correlation values representing correlations between 
the first sample and the respective other samples, on basis of an initial separation of an 
approximation of the luminance signal from the composite color television signal; 

- estimating a second set of penalty values representing relations between the 
first sample and the respective other samples; 

- computing a third set of combined values by means of combining respective 
elements of the first set of correlation values and the second set of penalty values; 

- selecting a particular sample of the composite color television signal on basis 
of the corresponding combined value compared to further combined values of the third set of 
combined values; and 

- detennining at least one final value of a set of values comprising a final 
luminance value and two color values corresponding to the first pixel on basis of the first 
sample and the particular sample. 
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ABSTRACT: 



A luminance and color separation filter unit (300) for extracting a luminance 
signal (7) and two color signals (17, V) from a composite color television signal (CVBS). 
The filter unit (300) comprises: acquisition means (302) to acquire a first sample of the 
composite color television signal, corresponding to a first pixel and other samples, 
corresponding to other pixels in a neighborhood of the first pixel; correlation estimation 
means (304) to estimate a first set of correlation values representing correlations between the 
first sample and the respective other samples; penalty estimation means (306) to estimate a 
second set of penalty values representing relations between the first sample and the 
respective other samples; computing means (308) to compute a third set of combined values 
by means of combining respective elements of the first set and the second set; selection 
means (3 10) to select a particular sample of the composite color television signal on basis of 
the corresponding combined value; and decoding means (3 12) to determine a final luminance 
value and two color values corresponding to the first pixel, on basis of the first sample and 
the particular sample. 

Fig. 3 
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